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(57)Abstract: 

PROBLEM TO BE SOLVED: To provide an image 
processing device and method which surely determines a 
vertical or horizontal correlation that is more intensive 
than the other and which can reproduce an image with 
no breaking. 

SOLUTION: This device processes output signals of an 
ACCD area sensor which has a color filter of a primary 
color RGB Bayer array on its light receiving surface, 
meanwhile, an fs/2 detection part 16 detects the 
presence of a frequency component that is multiplied by 
1/2 of th especial sampling frequency (fs) of an input 
image. At the same time, it's determined whether the 
detected frequency component is achromatic or not. 
When an fs/2 frequency component is detected, the 
R/G/B signals whose fs/2 frequency components are 
eliminated by a chromatic color processing circuit 102 
are primarily outputted in a chromatic mode. Then the 
R/G/B signals which have undergone a horizontal 
interpolation 103 or vertical interpolation 104 are 

primarily outputted via an achromatic color processing circuit 101 in an achromatic mode. 
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[00 2 9 JB9tt, VHtBB!Hfta*l 7*yJtl^*W)tH 

[ o o 3 o ] v HtsM^tasB 1 7 «. mmmmoymio 
5^^t»«K*^c*Tfflw«%*w-rs£fliJtiMiiiic 

ffiHIffi6 2 i, »IBiB*0±«JOiii*©H3RtiHR^S^ 
c^W8ii*ftHl"rs±*JfflBBfl*W@K6 3i, ttM 

-5TWJtBMfiimttl05S6 4i. C n6tBMfii^£ll[Hl2g6 

i-64 riwu l tc&mmmzmrfi y ^ > ;c g& u r a 

[0 0 3 1 ] _hlE«JSS<DVHtBBIHftUiaBl 75Ctel*r, 

50 fflH«-«ny-Y>SEjftia»6 5*6«. *¥*ieiflHi 



(6) 



ffiy-ORGain. LGain. TGain, BGa 
i n ^ J: [>';Kf IIR BSM y > R G a 1 n D. L 
GainD, TGainD, BGa i nD«HI(i 

[0 03 2] *4ti>fflntetU3 1 8 tiffllB*<D;&±fJ 

wffi#ffiiaB6 6 <t t ffipaii*©th»j©ia*oiii*ts 
*cca^^TfflM«*»U}-r*&±«ifflBiifi»ai@Be 

MiltiWWOD lGain-D4Ga 

[0 03 3] *¥^4;£fa£l4&4*fa«S 
t*tCi6£LTC>ftC>/ctf>. VH - *4tf>Jt«@B6 OCCto 

CCctO. !4tol«ratijEffly^>VHGa in, D G a i 20 

G = G r x RG a i n + G 1 x L G a i n 

+G t xTGa in+GbxBGa i n 
[003 7] «4^4*IfiJtCOCi-Cfel3«CC, «±«J. £ *StTbftS„ 
±ffiL £Tffil «TflBO&tB«ffl*aaEI»8 2. 8 3, 
84, 8 5tCi5C^r, D 1/D2/D3/D4(D§7j|S] 
CMira^-S^lSSh, «*B8 6. 8 7, 8 8. 8 

tcmftWmmyjyD 1 Ga i n, D2Gain, D3 
Gain, D 4 G a i n#*ft€^htfK*6hfcgL tBW 30 
S9 0-9 2V&L£t>$ti&Ctfc£~>Xfflatm&X 
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* [0034] m^X, WB»1 5CC*sWSR/G/B(D 
[0 0 3 5 ] 0 1 Ote, G«ffl8B2 0Ofttt(fitt«flEO 

— mzntt-fu zmxfoho sioccfe^r. e^gt 

^CDGCDr : -^(i*¥g[t4*f^, BP ^affll iffl'J- ± 
fflL T«O«tBWflB*H0B7 1, 7 2, 7 3, 7 4CC 
-€-h*tifltt&3*i, Ch6ffiHfflJ^EIB7 1. 72, 
7 3, 7 4 taoimAjjfoCDffiffl-?- #G r , G 1 , G 
t. Gb«^n^, cn6Mf- ; ;Gr, Gl, 
Gt, Gblt ttBH"S*lol5CLPF*arci-c4flt 

[0 0 3 6 ] Wf-^Gr, Gl, Gt. Gntf& 
iiS7 5, 7 6, 7 7. 7 8CCfc^T. 0 9fcin 

rvH«ia«iffl*i 7-c8tss*ifc»iiai«». an^*¥ 

fitt1Srflffi^>RGa i n, LGain, TGai 
n, BGa i n#*ft*ft8K*6ft£. *b"C* 
79-8 ITlHIffStlSCteCctO. GcOffiPnWH^f 
*>h£ D fflffl«lSaOG©iii«f : -*63:. ( 1 ) 



( 1 ) 



[0 03 8 ] *¥se4^isiffiBii«a/iirHitcj: 

CCJc^GOli^x-^Gd^. ttSCc^fctfr (2) S 
*46?)ffl[ffli E «iEfflV^>VHGa i n, DGainJC<to 



G=GvhxVHGa l n + GdxDGa i n 



(2) 



[0 0 3 9] a 1 Hi. R, BttfflSPl 9, 2 1 <D&» 
W^WfiSO-flai^T^P^^iariS,, COR, Bffl 
BBSl 9 , 2 1 (Dffimcr>^Xte, M 1 0 GffiRfl 
9IS2 OOttJSiS^WKlBICt:***. HI 

1 0 10 iBI*»^c«E|— ^4ff L-C^t-C* 
4. tctcL. 2EflB, ±«, -FCWcD&ffiBBfflSnffllH 

B7r,72',73',74 / tCfcl^Mf-^ 

<z>£$i£icoi>T«\ GO»^tcj;b^T^&-c&&,> * 
(DM&tLX 2 o&O, RBffiP^ffltBBB^ffi^tf^Ci 
<b, G/2fiE»*RBtclnx.Sfc*r*4c 
[0 04 0 ] <£<Dtc$>, RGHMIfflfflB8*ffl». 

Iil«<D«#^e>Rfi^/Bfi^4tlBlt-4IBtc, 5t*EU 
fc*¥16RGiBffl^>RGainD, LGain 
D, TGainD, BGainD£. R/B#fflOffiffl 



40 



[0 04 UB12B. f s/2jfjEjafflSB2 2<Z>ft<* 
[0 042] 01 2 0C*5C»-C. RGBff^-ii. 

AoasiB i o i *cfctf«#&B«HHB 1 o 2 tctti&s 
hi. m^&mwm^i 0 1 A^sHt sc^ur* 

^*Ini©ISBHI»H*?f 9 BHB 10 3 4. A^fBi 

«cc»Lr»#^o«iaij«ra*tf ^seifraaBi 0 

At, cneiF«1 0 3, 1 0 4<D&ttitrtCttl,X 
f s/2*fflSl 6*6^Ae>h4*ira«»WhHGa 
in, WhVGain*»M*JB10 5, 106 
t, Cti£*»Sl 0 5. 1 0 6(D»f6ifffi**ttWr 
&JJ0WS1 0 7 4tWT4t»JS<!:tto-Cl^„ 
[0 04 3] C<Ojfc^affl»IiaB 1 0 1 «r«fc(i^ 

*£ffil 0 8-Cf s/2t£ffiSBl 6 
fflRB«WhGa i n*s»We>tifd$. MSS 1 0 9<D 

— #<da*±&So mu^\o^<oms<DKf)t^x 

W^fefla»ffllHlB 1 0 2«rSfc(t^C. ^mSl 1 



(7) 



11 



0^ f s/2ttfflan 6fr^Afch&tiffl«SKWhG 
a i n^6»ffl3n5lSB«»WhGa i n' 
4>©**4*.6ft5. tfiHKSSfcWhGa in' W*. 
^OWMWhGa i n*5KCiCci:Dff 

^£&tt£ftof s/2 y^Ktcjz^xmj&S 

[0 04 4] mn&i 0 9©Jtn»ffl*w. *ssi i i io 

tf s/2«itH»l 6*6^iL5ti4MBI«»G2Ga 
i nW^ti/dS, fium^l 1 2©-#<DA*£fc 
£ 0 *fc. R/G/B<7)^WSP1 9, 2 0. 2 1*6 

eu&3hs§ttiBWWjR i p/g i p/b i p«. urn 

SI 13tf s/2^ma51 6^6-^*6tl*»BM*a 
G 2 Ga i n*e>*ttlSnSliPfl«f»G2Ga i n' * 

flnmS 1 1 2<Dte^T<DA^i&4 a ft 
*>\ »1MG2Ga in' tt, SfiufcOtBH 
<&$*G2Ga m^K C £CC<fc *)W\ti£tiZ>o HI 4 
fct. f s/2ffiIEMffi3i52 2tcfc^SffliE«a©«fca:H 20 

t<D^0^^M>&<fc5tc, ffilE&IItiR 
/G / B co&fl ^ C cb tcif =bft £ o 
[004 5] ±fE«RE©iB«aHft»tcfec»'r. f s / 
2*ffl»l H5(C7S-rf s/2«ttH*2 7 

tcioT: f s/2coj§^^offacDWit^ffl3^ 

5. ^teto^ &5>»a©Gfi#*f s/2SBi7^^ 
22 3fcJ;tf f s/4jlift:M Jl>£24lcjlU fs/ 
2^ffi[elIES2 5Ccfel>X, th^^^WfiYO© 

a»»m^iEft6«, f s/2os?ft»)S^??.fe-rs 30 

[0 046] i/c «^&*&ffi^2 

x«s x 5mm<Dffimxm&&x&&frm*ommni 

frti&o -Tftfct, 08 (B) ^W^&J^c. a 

4 5, 4 6iaifc», «*tffiffclHlSS4 7, 4 8-ClBJPt 
ffifciO. *Ja*'*> F^*? ^#4 5, 4 6<h«(t 
^L/c^tfHcn-Ax? * ;l£4 9, 5 0 £fflL/dfi(D 
^ 'hiSt^OSffi (WhV/WhH) SKYO 

[0 04 7 ] -tOT, f s/2»jE*ffl»2 2CCte^T 
fct, f s/2^mSCl 6<Df s/28Hti&2 Ifrh^-Z- 
6<aS1*PamaG2Ga in, G2Ga i n' , 3fcWC 
«6»fe1ftffi*2 8*6^il6na*SllB«aWhHGa i 
n, WhVGa i n <fc CflBHKfcSW h G a i n. Wh 
Gain' vCg^VC f s / 2 <Dffi$&1$ l ft<DK1±% 

Vtibbft^ti. £tcfc\iiLtcm£xfo^xm&&<Dt 
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[0 04 8 ]5tlf\ f s/2(Dmm$lf&tt<Dft1±$:tftti!i 

Dfet^ci^6, ii^co rgb ffirmmmft) ti 

f stfcffigpl 6<Df s/2itHS2 7^64x.^n^i 
MG2Ga i nW^<, ^offiRfl&tfcG 2 G a i 
n' ^8l»ci)&>6, JHJKB1 1 2 r©S^<Z)hb^ 

R/G/BO&fiRBSPl 9. 2 0. 2 1^8»&3 
tiSSWIHUl^R I P/G I P/B I PfflWiXifc*) . 

maajjR 1 p/g 1 p/b 1 ptfitorw^sti 

5. 

[004 9]^. f s/2<DSifta«^OffaE*«iai 

6tt5tBrafl$fcWhGa 1 n*VJ»3<, j&>ofiBBBfl3fcW 
hGain' *A#^C<b^6, JJOHS 1 0 9 X <DM£ 

ottm*. mmnmvmmKi o 2iw^i&o, w# 

fiJB«!«I|n|» 102"Cf s/2 ©Biffi^#*5|&*3*i 
/tR/G/BCD&M^#i£0Tffl^3ft£ o CCOi 
ftfflWl 1 2-C0«£0tfc*tt, f s/2<DJH$|!( 

^otfefflusrAs*^, ^effli&aiaK 1 o 2ww 
[oo5o]-^ f s/2©jaaa»j*»©#aE**ai 

f s/2<D««rC*oTfc, *¥t0f»#«C>*\ s 

MaiHisg i o i tcfen-c, fc#ert*tHriHB s tifcft 

R BP^jfclJfelftfflS2 8^6#A6nSMPa»»Wh 
HGain, WhVGa i n ^ffll^r?K¥fflP^@S§ 1 0 
3*«fcm^£&atflli!lsll&l 0 4£S/di^£CDj££ 

^„ c<om£. m&&ftm&x&6tc&. iuos^ 

[0 0 5 1 ] ±&btc£*>t<C. f s/2<Dfflmv$ft<» 

R/G/B<D&ffim$£l 9, 2 0, 2i-ctir^a 
Sti/cMtU^R I P/G I P/B I P4ffiffl«rcc, 
f s/2©a«ft«»*i|»£SiiteR/G/B<Dm^* 

tf^P£HC, f s/2<D^PJJi*a^*o"C4>, f s/2 

[0 0 5 2 3 L^fe. f s/20JB«»Jat^*ttUIL/c 
«^tc*5C»-C, *^ei«£Lte»^5Ctt, f s/2© 

jH*^»^i**s*ifcR/G/Bofi^*«6mi*r 

^«:*5WSJB«*t f s/2tB3*r±tfSCi*iRlSB 
i^JT^o "Wilt. VGA (Video Graphics Array) 



(8) 



13 



* 



(6 40 X4 8 0) Bi*<0»a^*5C»-C. M^&Oi&W 
»VtiMteBLWt s/2«3T*S4 8 0#*-C»l|-C 

[0 0 5 3 ] H 1 5«. #ffeWte«5#^<D-W*^ 

U>X12 1^«?^aotCCDx 
>J7^>tl2 2CD^*ffi (tftfeffi) i:CCfe&5ft£ 0 
CCDx'jn>fl 2 2<DS#B±fc«. feEW^W 

tl»5. CCDi'irt>tl2 2(t CCDBHrtsIB 10 

[0 054 ] CCDx»J7-fe>iM 2 2£>ttJ2j(I-S|ttiB 

1 2 5ccflt*&s*i, m*<Dmm&mfrftt>ti 
£ D ctoiMIM 1 2 5 <b , 7k¥Sifite<fccm 

[0 05 5] COOJ:^ WAtfKfe^Y+iffiPJ©*^ 
-7^^>12 3^oCCDi'J7t>-!t 1 2 2 £}i 

4M^*aa*?f ^pscc, f s /2CD^m^RX5>^# 

LPF^ffl^t f s/2ttiBDl/^#>X*0i-r4* 
[0056] 

fi^fciaa-rsiKcc, f s/2oja»8teS^o?¥-ft i &tft 

CciO. f s/2fliSOfflBS*BlO»1ftffl*l»it"C** 
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[@i ] *^tci^ia^ffia«H(Z)S*m)S^^^ ^ 

[0 2] y jU5f0Hfi^^+S!y'J0"C*€>o 

[04] lirBWo^JS^w^"*"^ 0 ^^^**- 

[05] f s/2ttffl^*<*W&«lfiE<D--«*7n-r^ 
[06] f s/2fcfflffitC;fetf&ffia:7 ^ Jl/*<D^lfflJS 

[07] affiY0OtftWO«^H"C*5o 

[08] f s/2*feffl©«AHr*»3. (A)ttf s/ 

2*a«*. (b) ««^a«iiiim%*n-en7SU'ro» 
[09] vHtHM*ai»te<fc^»*«Mttmaiwft*w 

[010] Gliffl®©a#Wtt1«flEO-M**r ? 
[0 1 1 ] R, BftBB»oa#Wftfll*S©— Wi^T^ 
[012] f s / 2«iEftiffl»0**Wtt«SSO-W* 
[013] fs/2h7-v ^fcOftttH-C**. 

[014] f s/2i*iE«a©«^^*>£. 

[015] *^tCftS^^^O-«*^TlHIllS»JaH 

[016] wm*w&irzfcto<»wrc*>z>* 

11, 12 3-^-7^JW. 12. 122-CCD 
iijr-b>t, 14-tfefflffi. lS-fcBRBBB. 16-f 
s/2&£B3P. 1 7-VHtHW1*ffla5. 18*"M« 

9-R»n». 20 -Grams. 21-Bi 
wm. 22-f s/2«iE«a». 2 3-fs/2H 

2 4- f s/4«a7 y Jl/*. 25-fs/ 
2tttflBB, 2 6-*ft»iEH». 2 7- f s/2*Hl 
^ 2 8-&#&lftfflS* 2 9-*¥fiMU^»aiia 
IS. 3 0»-S6fe£U^SWlllB. 3 1-fs/2tB 
HfcHiHiS, 3 2*-*&^fitfctH®a& 



[02] 



[07] 



G 


R 


B 


G 



RGB 


4i) 






JL (1 4 6 4 1) 









*Y0 
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[81] 



[03] 



ceo 



t2CCO^'J 



15 



tana 



R/G/B 



16 



\13- 



[H4] 



ROB 

s 

RIP 



20 
QtP 



b«hos 



21 

BIP_ 



22 



\) k ~ 



15 



[H5 1 



R/GVB 



23 
















26 





25 27 



-G2Galn 



28 



29 



31 

1 32 VWiHGain 




[013] 




[08: 




Mvo 



(A) 




(B) 



(10) 



»H¥1 1-17 7 995 



[09] 



RQB- 



r 85 



^BGain 

^RQacnD 

-LOainD 

►BOalnD . 



17VmBM*tH» 



i -y*' 



J r 60 



Him 



^DQatn J 

-02 Gain 
*D3Galn 



D4Galn 



[HI 0] 




83 



87 



18 
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[mi 1 ] 



Q 




RIP/BIP 



[012] 



RIP/GIP/BtP - 



M ^fefflfeg 1Q3ll05 ,107 



18^2 

3 



^101 



,1 



s 



113 y 




112 

53 ^ R/Q/B 



(12) 
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(d) a<r>m*^<r>hmuLtzm£ 



